Collaborative Training of Tensors for Compositional Distributional Semantics
نویسنده
چکیده
Type-based compositional distributional semantic models present an interesting line of research into functional representations of linguistic meaning. One of the drawbacks of such models, however, is the lack of training data required to train each word-type combination. In this paper we address this by introducing training methods that share parameters between similar words. We show that these methods enable zero-shot learning for words that have no training data at all, as well as enabling construction of high-quality tensors from very few training examples per word.
منابع مشابه
Multi-Step Regression Learning for Compositional Distributional Semantics
We present a model for compositional distributional semantics related to the framework of Coecke et al. (2010), and emulating formal semantics by representing functions as tensors and arguments as vectors. We introduce a new learning method for tensors, generalising the approach of Baroni and Zamparelli (2010). We evaluate it on two benchmark data sets, and find it to outperform existing leadin...
متن کاملLow-Rank Tensors for Verbs in Compositional Distributional Semantics
Several compositional distributional semantic methods use tensors to model multi-way interactions between vectors. Unfortunately, the size of the tensors can make their use impractical in large-scale implementations. In this paper, we investigate whether we can match the performance of full tensors with low-rank approximations that use a fraction of the original number of parameters. We investi...
متن کاملTowards a Formal Distributional Semantics: Simulating Logical Calculi with Tensors
The development of compositional distributional models of semantics reconciling the empirical aspects of distributional semantics with the compositional aspects of formal semantics is a popular topic in the contemporary literature. This paper seeks to bring this reconciliation one step further by showing how the mathematical constructs commonly used in compositional distributional models, such ...
متن کاملReducing Dimensions of Tensors in Type-Driven Distributional Semantics
Compositional distributional semantics is a subfield of Computational Linguistics which investigates methods for representing the meanings of phrases and sentences. In this paper, we explore implementations of a framework based on Combinatory Categorial Grammar (CCG), in which words with certain grammatical types have meanings represented by multilinear maps (i.e. multi-dimensional arrays, or t...
متن کامل*SEM 2013: The Second Joint Conference on Lexical and Computational Semantics
The development of compositional distribu-tional models of semantics reconciling the em-pirical aspects of distributional semantics withthe compositional aspects of formal seman-tics is a popular topic in the contemporary lit-erature. This paper seeks to bring this rec-onciliation one step further by showing howthe mathematical constructs commonly usedin composit...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1607.02310 شماره
صفحات -
تاریخ انتشار 2016